Training a confidence measure for a reading tutor that listens
نویسندگان
چکیده
One issue in a Reading Tutor that listens is to determine which words the student read correctly. We describe a confidence measure that uses a variety of features to estimate the probability that a word was read correctly. We trained two decision tree classifiers. The first classifier tries to fix insertion and substitution errors made by the speech decoder, while the second classifier tries to fix deletion errors. By applying the two classifiers together, we achieved a relative reduction in false alarm rate by 25.89% while holding the miscue detection rate constant.
منابع مشابه
Why and How Our Automated Reading Tutor Listens
Project LISTEN’s Reading Tutor listens to children read aloud, and helps them learn to read. This paper outlines how it gives feedback, how it uses ASR, and how we measure its accuracy. It describes how we model various aspects of oral reading, some ideas we tried, and lessons we have learned about acoustic models, lexical models, confidence scores, language models, alignment methods, and proso...
متن کاملThe Sounds of Silence: Towards Automated Evaluation of Student Learning in a Reading Tutor that Listens
We propose a paradigm for ecologically valid, authentic, unobtrusive, automatic, data-rich, fast, robust, and sensitive evaluation of computer-assisted student performance. We instantiate this paradigm in the context of a Reading Tutor that listens to children read aloud, and helps them. We introduce inter-word latency as a simple prosodic measure of assisted reading performance. Finally, to va...
متن کاملImproving Story Choice in a Reading Tutor that Listens
This abstract summarizes how we improved task choice – picking a story to read – in successive versions of a Reading Tutor that listens to elementary students read aloud. We wanted to motivate children to spend time on the Reading Tutor by giving them some choice in what to read, without spending too much time picking stories. We also wanted them to read plenty of new text, so as to build vocab...
متن کاملImproving Language Models by Learning from Speech Recognition Errors in a Reading Tutor that Listens
Lowering the perplexity of a language model does not always translate into higher speech recognition accuracy. Our goal is to improve language models by learning from speech recognition errors. In this paper we present an algorithm that first learns to predict which n–grams are likely to increase recognition errors, and then uses that prediction to improve language models so that the errors are...
متن کاملEvaluating the effect of predicting oral reading miscues
This paper extends and evaluates previously published methods for predicting likely miscues in children’s oral reading in a Reading Tutor that listens. The goal is to improve the speech recognizer’s ability to detect miscues but limit the number of “false alarms” (correctly read words misclassified as incorrect). The “rote” method listens for specific miscues from a training corpus. The “extrap...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003